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1 Introduction 

This paper deals with the study of a class of non-cooperative differential games 
in infinite time horizon. Namely, we consider a game with dynamics 

n 

± = ^a 4 , x(0)=y, (1.1) 

i=l 

where each player acts on his control a% to minimize an exponentially discounted 
cost of the form 

/>oo 

Ma) = / e~ l 
Jo 

both hi being integrable functions, whose smoothness will be addressed later. 
Very few results are known on the subject, except in two particular cases: two 
players zero-sum games and LQ games (where LQ stands for linear-quadratic). 
Indeed, a key step in this kind of problems is the study of the value function u. 
In the region where u is smooth, its components satisfy a system of Hamilton- 
Jacobi equations (see 0), and this system is usually difficult to solve. 

In the case of two players zero-sum games, since what one player gains is 
exactly what the other player loses, the two components of u are one the opposite 
of the other. Hence, the Hamilton- Jacobi system (HJ in the following) reduces 
to a single equation and one can apply the standard theory of viscosity solutions 
(see for more details) to obtain existence and uniqueness results. 

In the case of LQ games, the HJ system can be connected to a Riccati system 
of ODE for matrices. This system is in general much easier than the original one, 
and standard ODE techniques can be applied (see 6 for a detailed treatment). 

On the other hand, in the present case both approaches fail and therefore 
one has no established techniques to rely on. However, few results still can be 
proved. 

In the finite horizon setting, the analysis presented in 00] showed that, for 
a non-cooperative n-players differential game with general terminal payoffs, the 
well-posedness is strongly related with the HJ system being hyperbolic. Namely, 
for thanks to recent advances in the theory of hyperbolic systems of PDE, 

games with strictly hyperbolic HJ systems are well-posed. On the other hand, 



hi(x(t)) 



dt . 



(1.2) 



it is possible to produce examples of games, even in one spatial dimension, 
whose corresponding HJ system is not even weakly hyperbolic and, hence, it is 
ill-posed. 

A first attempt to study this problem in the infinite horizon setting, for two 
players, was made in [2J. The same simple game was considered, and it was 
proved that, depending on the monotonicity of the cost functions, very different 
situations could arise. Indeed, the HJ system in this case takes the following 
form 



But with a system of this form, we can end up with too many solutions. 
We find not only value functions u that leads to Nash equilibria in feedback 
form, but also solutions that does not represent equilibria of the game. It is 
then necessary to introduce a suitable concept of admissibility. In particular 
we say that a solution u is admissible, if u is a Caratheodory solution of 11. 3|) . 
which grows at most linearly as |x| — > oo and satisfies suitable jump conditions 
in points where its derivatives are discontinuous. For such a kind of solutions, a 
verification theorem was proved: given an admissible solution u and denoted by 
•a\ the components of its derivatives, then at — ~u[ provide a Nash equilibrium 
solution in feedback form. 

In |2] , it turned out that existence and uniqueness of admissible solution for 
<|1.3fl heavily depend on the choice of the costs. 

First, suppose that both the cost functionals are increasing (resp. decreas- 
ing). This means that both players would like to steer the game in the same 
direction, namely the direction along which their costs decreases. In this case an 
admissible solution always exists, and it is also unique, provided a small oscilla- 
tions assumption is satisfied. This existence result was in some sense expected, 
since this case corresponds, in the finite horizon setting, to the hyperbolic one 
studied in |3J. 

Suppose now that the cost functionals have opposite monotonicity. This 
means that the players have conflicting interests, since they would like the game 
to go in different directions. In this case it is known, see 0], that the finite 
horizon problem is in general ill-posed. On the same line, for our game, it 
is enough to consider two linear functionals with opposite slopes (say k,—k, 
for any real number k ^ 0) to find infinitely many admissible solutions, and 
hence infinitely many Nash equilibria in feedback form. Nevertheless, quite 
surprisingly, it's still possible to recover existence and uniqueness of admissible 
solutions to l|1.3|) in the case of costs that are small perturbation of linear ones, 
but with slopes that are not exactly opposite. 

This richness of different situations reflects in some sense the results found 
in Indeed, the exact same dynamics was studied, in the finite horizon case, 
with only exit costs. Main differences between p] and OHO] lay in the concept 
of solution. The authors of |S] look for discontinuous feedback controls that not 




(1.3) 
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only leads to Nash equilibria, but also satisfies a sort of programming principle. 
This resulted in (uncountable) infinitely many solutions, at price of stronger 
assumptions on the final costs. 

While the cost functionals considered in [2] were a small perturbation of 
afiine costs, in the present paper we study a wider class of cost functions. Moti- 
vated by the theory of hyperbolic systems [?] , we now consider piecewise linear 
cost functionals, whose derivative has jumps. This setting is a natural first step 
towards the analysis of existence and uniqueness of Nash equilibrium solutions 
for non-linear costs. 

Again, as in 2], we reach different results depending on the signs chosen 
for h^. Indeed, as it will be proved in the following sections, if we are in the 
cooperative situation for all x, we can still recover a unique admissible solution 
for (|1.3() . On the other hand, any change in the behavior of the costs will 
translate in some sort of instability of the game, leading either to infinitely 
many admissible solution, or to one unique admissible solution, or even to no 
admissible solution at all, only depending on the particular choices of the slopes 

In conclusion, this great variety of arising situations seems to suggest that 
the present approach is not the most suitable one to deal with the intrinsic issues 
of the problem. In particular, we can provide examples of very simple differential 
games where no Caratheodory solution with sublinear growth at infinity exists. 
Recalling that, in the case of smooth costs (see |2]), this class of solutions was 
exactly the right one to find Nash equilibria in feedback form, our study strongly 
suggest that a different approach is needed: either to look for Pareto optima, 
as in 0], or to introduce some other relaxed concept of equilibrium. 

The structure of the present paper is the following. In Section 2 we will 
introduce main notations and definitions. Moreover we will recall briefly what 
was proved in the case of smooth costs and provide a couple of useful Lemmas. 
In Section 3 we will present and prove the main results of this paper, dealing 
with cooperative players, in the sense of players whose costs always have the 
same monotonicity. In this case existence and uniqueness results hold for both 
piecewise linear and piecewise smooth cost functionals. In Section 4 we will 
prove that a similar extension is not possible in the case of conflicting interests. 
Actually, we will provide an example in which the games has infinitely many 
Nash equilibria, as well as an example in which there cannot be any admissible 
solution to (|1.3|) . Finally, in Section 5, we will discuss a last case that can arise 
when either one or both the cost functionals are allowed to change monotonic- 
ity. From this game which is partially "cooperative" (in the sense above) and 
partially "conflicting" , infinitely many Nash equilibria can be found. 

2 Preliminaries 

In this paper we consider a scalar 2-persons differential game, with dynamics 

x = ai + a 2 , (2.1) 
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x(0)=y. 



(2.2) 



The functions 1 1— > ai(t), i = 1, 2, represent the controls implemented by the «-th 
player, chosen within a compact set of admissible controls Ai C K. The game 
takes place on [0, +oo[ and each player is subject to a running cost, exponentially 
discounted, of the following form 

/>oo 

Ji(ai) = / e"* 
Jo 

Assume here that both hi are piecewise smooth functions with bounded deriva- 
tives. Later we will weaken this requirements. 

A couple of feedback strategies (al(x), a 2 (x)) represents a Nash equilibrium 
solution for the game 

(2HJHIE21 if thc following holds. For i G {1,2}, the 
feedback control at = ct*(x) provides a solution to the the optimal control 
problem for the i-th player, 

min Ji{ai), (2.4) 
««(•) 

where the dynamics of the system is 

x = fi(x, oti) + fj(x, a*(x)), Oi(t) G Ai, j ^ i . (2.5) 

More precisely, we require that, for every initial data the Cauchy problem 

x = fi(x,al{x)) + f 2 (x,a* 2 (x)) , x(0) = y , (2.6) 

should have at least one Caratheodory solution t i— > x(t), defined for all t G 
[0, oof. Moreover, for every such solution and each i = 1, . . . , m, the cost to the 
z-th player should provide the minimum for the optimal control problem l|2.4|l - 
H2.5J) . We recall that a Caratheodory solution is an absolutely continuous func- 
tion t i— * x(t) which satisfies the differential equation in l|2.6() at almost every 
t > 0. 

By the theory of optimal control, see for example PP, we know that if u is 
the value function corresponding to (|2.1|I - H2.2|I with costs 

POO 

Ji{on) = j e~* tpi(x(t), cti{t)) dt , 
Jo 

then, where u is smooth, each component ui should provide a solution to the 
corresponding scalar Hamilton-Jacobi-Bellman equation. The vector function u 
thus satisfies the stationary system of equations 

Ui(x) = Hi(x, u[, u' 2 ) , (2.7) 

where the Hamiltonian functions Hi are defined as follows. For each pel, 
assume that there exists an optimal control value a*(x,p) such that 

p ■ a*(x,p) + ^pj(x, a*(x,p)) — min [p ■ a + tpj(x, a)} . (2.8) 



hi(x(t)) 



dt. 



(2.3) 
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Then 

Hi(x, pijPa) = Pi ■ ot*j(x,pj) + tpi(x, a*(x,pi)) . (2.9) 

for i, j S {1, 2} and i ^ j. In general, even in cases as easy as ipi — af/2, this 
system will have infinitely many solutions defined on the whole R (sec Example 1 
in And not every solution corresponds to a Nash equilibrium for the initial 
game. To single out a (hopefully unique) admissible solution, and therefore 
a Nash equilibrium for the differential game, additional requirements must be 
imposed. Namely a solution u to l|2.7|l is said to be an admissible solution if the 
following holds: 

(Al) u is absolutely continuous and its derivative u' satisfies <|2.7|) at a.e. point 

(A2) u has sublinear growth at infinity; namely, there exists a constant C 
such that, for all x £ R, 

\u(x)\ < C(l + M) • (2.10) 

(A3) At every point yGK, the derivative u' admits right and left limits u'(y+). 
u'(y— ) and at points where u' is discontinuous, these limits satisfy at least 
one of the conditions 

u' 1 (y+) + u' 2 (y+) <0 or u'^y-) + u' 2 (y-) > . (2.11) 

Because of the assumption on h\, the cost functions hi are Lipschitz con- 
tinuous. It is thus natural to require the value functions Ui to be absolutely 
continuous, with sub- linear growth as x — + ±oo. The motivation for the as- 
sumption (A3) is quite simple. Observing that, in 1)2.8(1 . the feedback controls 
are a* = — u[, the condition (|2.11|) provides the existence of a local solution to 
the Cauchy problem 

x = —u'^x) — u' 2 (x) , x(0) = y 

forward in time. In the opposite case, solutions of the O.D.E. would approach 
y from both sides, and be trapped. 

Notice that, for 2-players games, the assumptions (A3) is equivalent to 

u[(y+)+u' 2 (y+)<0, u'^y-) = -u' i {y+) (i = l,2). (2.12) 

This concept of admissibility turns out to be the right one. Indeed, the 
following verification theorem can be proved (see again 0). 

Theorem 1 Consider the differential game \2.1\) - \2. 6 2]) . Let u : M t-y R m be 
an admissible solution to the systems of H-J equations |ff.7| ), so that the condi- 
tions (A1)-(A3) hold. Then the controls a* = —u[ provide a Nash equilibrium 
solution in feedback form. 
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Anyway, this theorem says nothing about the actual existence of admissible 
solutions to (|2.7() . To deal with this problem, some manipulations have to 
be done on 1|2.7|) itself. Indeed, in the present case of costs as in (|1.2|) . the 
Hamiltonian functions (|2.9|1 lead to 



u\(x) = hi(x) — u[u 2 — (u[) 2 /2 , 

u 2 {x) = h 2 (x) - u[u 2 - (u' 2 ) 2 /2 . 
Differentiating l|2.13[l w.r.t. x and setting pi = u\ one obtains the system 

h'i - Pi = (pi + p 2 )p'i + P1P2 > 



(2.13) 



(2.14) 



K ~P2= P2P1 + (Pi + P2)p' 2 



Set 

Hp) 

and notice that 



Pi + P2 Pi 
P2 Pi + P2 



1 



A(p) = det A(p) , 



^(p 2 1+ p 2 2 )<A(p)<2(pl 



Pi) 



(2.15) 



In particular, A(p) > for all p = (pi,p 2 ) ^ (0,0). Hence, A(p) is invertible 
outside the origin and, for p ^ (0, 0), we can restrict the study to the equivalent 
system 



Pi 



P2 



A(p)- 1 [-p 2 2 + (ti 2 -ti 1 ) P2 + ti 2 pi] . 



(2.16) 



Now define a new variable s such that ds/dx = A(p)" 1 . Using s as a new 
independent variable, we write pi = Pi(s) and hi = hi{x{s)) and study the 
equivalent system 



r _d 

ds 



■jrPi = {hi - h' 2 )pi + h[p 2 - p\ 



(2.17) 



^ -j-P2 = {h' 2 - K)p 2 + h' 2 pi - p\ 



We underline that it is possible to choose the rescaling in order to map to 
0. This choice will be assumed in the following, so that s(0) = 0. 
In this new variable, as it was proved [2], every unbounded trajectory p(s) 
of H2.17fl actually blows up at finite s , and it corresponds to an unbounded 
trajectory p{x) that tends to 00 as |a;| — > 00. Since 



dx 
ds 



a(pOO) > 



{So - S) 2 ' 



G 



it follows that u{x) increases more than linearly as x — > oo. Therefore, u is not 
admissible. 

It remains to consider trajectories of i|2.17|l that tend to the origin, i.e. to 
the point where our change of variables is singular. In ,2 it was proven that, 
by H2.15|) . these solutions satisfy 

= A(p(«)) = <D{1) ■ e~ 2c °^ . 

In the original variable x, to the whole trajectory s <— > p(s) there corresponds 
only a portion of trajectory x i— > p(x), say either for x G ]x , oo[ or x € ] — 
oo, jg [. Another trajectory s i— > p(s) has to be constructed to extend the solution 
to all x £ K. 

For the system (|2.17|) . in the case of smooth functions hi, h 2 such that |/i^(a;)| < 
C, we already know the following results (see 0): 

Theorem 2 Let the cost functions h\,h 2 be smooth, and assume that their 
derivatives satisfy 

^<K(x)<c 

for some constant C > 1 and all x £ K. Then the system }2.1ci\) has an ad- 
missible solution and the corresponding functions a* = —u^ provide a Nash 
equilibrium solution to the non-cooperative game \2.1^ - \2. 6 ^i . Assume moreover 
that the oscillation of their derivatives satisfies 

sup \h^(x) - h^y)] <S, i = l,2 

for some 5 > sufficiently small (depending only on C). Then the admissible 
solution is also unique. 

Theorem 3 Let any two constants ki,K2 be given, with 

Kl < < K 2 , Kl + K 2 . 

Then there exists 5 > such that the following holds. If h\,hi are smooth 
functions whose derivatives satisfy 

\h[(x) — Ki\ < S , | h' 2 (x) — K2 | < S , 

for all then the system of H-J equations \2.1 r /{ has a unique admissible 

solution. 

In this paper, we want to look for admissible solutions when smoothness 
of functions hi is relaxed. Namely we consider functions hi that are piecewise 
linear, with a finite number of discontinuity in their derivatives. In other words 
we require that there exists a finite subdivision 

x Q = — oo < xx < . . . < xn < xn+i = +oo 



dx 
ds 
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of [—00, +00] and two (N + l)-tuple of constants (k*, . . . , n ri 
that 



N+l 



), i = 1, 2, such 



/i^(x) = k/^ if x G ]xj, x 



i = l,2, i = 0,. 



(2.18) 



Could be of use to remark that this assumption on h\ means that the sys- 
tem <|2.17(1 follows different dynamics in each interval Xj = ]xj, a?j+i[: indeed, 
in each Xj, (|2.17|) will have an equilibrium in (0, 0) and a second one in the point 

We also introduce the following notation (see Figure 1) 



At = < p(cos 9, sin 8) e 



p > 0, 9 e 



V 4 



(2.19) 



to label regions in R 2 , where we put our non-zero equilibria = (k{, k^)- 

Finally, we state a couple of easy properties we will need in the following. 
They provide expressions for both eigenvalues and eigenvectors of the system 
obtained linearizing (|2.17() around the origin. These expressions were already 
found in and they follow from simple linear algebra. 

Proposition 1 The linearized system near (0,0), corresponding to jtt.lty , has 
the following form 



H = 



Kl - K 2 
«2 



K 2 - K\ 



Moreover the eigenvalues of the matrix H are 
A- = -y/ (ki) 2 + (k 2 ) 2 - kik 2 , 



A+ = ^{m) 2 + (k 2 ) 2 - K 



1«2 



(2.20) 



(2.21) 
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with corresponding eigenvectors 



I K 2 - Ki- J(Kl) 2 + (k 2 ) 2 - KlK 2 \ 

'""I 1, * )• 

(2.22) 

^ J' 

One can immediately see that the eigenvectors in ()2.22JI depend actually by the 
ratio between n 2 and K\ only. Moreover it turns out that this kind of dependence 
is indeed monotone increasing, as proved in the following Proposition. 

Proposition 2 Set ot= Then the directions corresponding to the eigenvec- 
tors u_ and v + are given (respectively) by the maps 



G_(a): 



g-{a); 



G+(a): 



9+ (a): 



1 0,oo [ -> ]-2 1 



2 



o 



a — 1 — Va 2 - « + 1 



-oo,0[ -> ]-oo,-2[ 



a 1—* a — 1 — Va 2 — a + 1 
|0,oo[ -> ]0,oo[ 



a 



1—* a — 1 + 



]-°o,0[ - ]-~,0 



2 

a — 1 + \/ a 2 — a + 1 



depending on the sign of a (and hence of Ki ■ k 2 ). These maps satisfy 
£G->0, £G + >0, 

(2.23) 

sS->0, ^5+ >0. 

Proof. The properties follow from 



f n -\ ' ( ^ ^ 2a Z 1 y/(2a - l) 2 + 3 - (2a ~ 1) 
G (a) = (a) = 1 = = — = > 0, 

~ V ; V 7 2Va 2 - a + 1 2Va 2 - a + 1 



w , , , , , - , 2a -1 v /(2a-l) 2 + 3+(2a-l) 

Gift = q , (a) = 1 H = = — = > . 

+ V ^ y+V ' 2Va 2 - a + 1 2V« 2 - a + 1 



and from 



lim G_(a) = lim 5 _(a) = -1 - 1 = -2 . 
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Figure 2 



lim G+(a) = lim g+(a) = -1 + 1 = 0, 

q^O+ a— >0- 

lim G-(a) — lim -==== = — , 

^+°° a->+oo a -l + y/(a - l) 2 + a 2 

lim q + (a) = lim a = , 

:^-oo a^-oo a- 1 - ^(a - I) 2 + a 2 

lim G_|_(a) = +oo , 

a — >+oo 

lim g_ (a) — — oo . 

a — > — oo 

□ 



3 Cooperative Situation 

We start considering all K J = (rej, k 3 2 ) in .AiU.42- Notice that a similar analysis, 
with straightforward adaptations, can be done if the K 3 are in A5 U A%. This 
choice implies that our system follows the dynamics depicted in Figure 2. 

Theorem 4 Let the cost junctions be as in and assume that the 

constants (rej,^) are all chosen in A.\ U A2- Then the system \2.13\l has a 
unique admissible solution and the corresponding functions a* — —u^ provide a 
Nash equilibrium solution to the non-cooperative game Yri.l\) - \2.2]) . 
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Proof. Existence. The existence of an admissible solution is very easy to 
prove. Indeed, it is enough to glue together pieces of admissible solutions in 
each interval Tj . We proceed as follows: 

• in T a , we set p° = K° = (n°, k^); 



for j > 1, in Tj we set p 3 the unique solution of the Cauchy problem 
for 1|2.17[) with initial datum p(s(xj)) — p 3 ^ 1 {s{xj)). Since the set 

r J ' = l(Pi,P2)\pi,P2 e [o,2C 1 ], Pl +p 2 > Cl 



where 



2 



C 1 =max { 44^^,^^}, 



2 ' 2 

C 2 = mm{K\, «4, pf 1 (s(xj)) +P2~ 1 ( s ( a; j))} . 

is positively invariant for (|2.17l) . each p- 7 will exists up to s(x 3+1 ) without 
reaching (0, 0) and remaining bounded; 

Then, it is well defined the continuous function p given by p(x) = p 3 (x) when- 
ever x € Tj. Its admissibility is an immediate consequence of its continuity and 
the admissibility of each p 3 . 

Uniqueness. To prove that the solution built above is the unique admissible 
solution to H2.17(l . we start proving uniqueness on T . 

We know from 2 that, for s negative small enough (eventually for s — > — oo), 
the only solutions that remain bounded are the equilibrium K° itself and the 
unstable orbits exiting from the origin. Therefore, these are the unique possible 
choices, in order to retaain admissibility. If we choose an unstable orbit in place 
of K°, in the original variable x it would correspond to a solution defined only 
for x > x (for a suitable x ). To define the solution also for x < x , we should 
need a solution to 

Pi = - K l)Pl + K lP2 - Pi , 

P2 = ( K 2 - K l)P2 + K2P1 - p\ , 

that tends to the origin as s — > +00 and remains bounded for all negative s. 
But we know from [2] that no solution with both these properties exists. Hence 
the uniqueness of the solution follows on T Q . 

For s > s(xi), the smoothness of the right hand side of l|2.17|l in each interval 
Tj ensures that p is the unique continuous solution. 

It remains to prove that there exists no solution with admissible jumps in 
s > s(x\). But this property follows from (|2.12(l and from the positive invariance 
of the sets 

r + = {(pi,P2) g R 2 \ P i > 0, P2 > 0} , 
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r- = {( Pl ,p 2 )eR 2 \ Pl <o, p 2 <o} . 

Indeed, for s > s(xi) a solution can have only jumps from T + to T~ . Hence, 
recalling [2], after a first jump the solution would be forced to remain in T~ 
and to tend towards oo. In the x variable, this would translate into a solution 
u(x) that grows more than linearly as \x\ — > oo, and this would contradict 
admissibility. □ 

In light of Theorem on the same line of (2), it is natural to ask whether 
the result still hold for perturbations of l|2.3|> or it fails. Actually, we can prove 
the following Theorem. 

Theorem 5 Let the cost functions h! x , h! 2 in be smooth, and assume that: 

(1) their derivatives satisfy 

£ < Kip) < c 

for some constant C > 1 and all x £ M; 

(2) on T , the following additional assumption is satisfied 

sup \K{0-h'M\ <S * = 1,2. (3.1) 

for some 5 > sufficiently small (depending only on C ). 
Then the system $2.1, c j\) has a unique admissible solution. 

Proof. We can proceed as in Theorem using Theorem [21 to deal with the 
perturbations. Indeed, for s < s(xi) Theorem [21 implies that there exists a 
unique admissible solution, say p°. Hence, an admissible solution on the whole 
real line can be built as in the previous case: for x £]xj,Xj+i[, j > 1, we 
define p(x) — p J (x) where pi is the unique solution to Ij2.13|l with initial datum 
p(s(xj)) = pP^ 1 (s(xj)). Exactly as in Thcorcm01 this function is well defined 
and is a continuous admissible solution to (|2.17|) . Since the sets T + and T~ are 
still positively invariant, also uniqueness can be proved by means of the same 
arguments used in Theorem 01 □ 

Remark 1 We underline that the presence of the small oscillations assump- 
tion is uniquely motivated by the use of Theorem^ which requires yS.l}) 
to provide a unique admissible solution for s < s(x ). 

4 Conflicting interests 

In this section we assume that the two players have conflicting interests, i.e. 
their costs satisfy h[(x) ■ h' 2 (x) < —C < for all x G K. For particular choices 
of smooth costs, this situation can produce infinitely many Nash equilibria to 
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Pi 




Figure 3 



the game (see 0). Nevertheless Theorem [3] shows that, for costs which are 
not exactly opposite and under suitable assumptions of small oscillations, it is 
possible to recover existence and uniqueness of Nash equilibria. This is not the 
case for costs as in (I2.3|l . 

4.1 Case 1 

Let us consider j = 1 in (|2.3|) . i.e. let us consider cost functional that have a 
single jump in their derivatives. In particular, assume this jump is located at 
x = s(x) — 0. Moreover, let us choose the constants K 3 = k 3 2 ), j ~ 0, 1, so 
that K° e Ai and K 1 e A 3 . 

Under these assumptions, the dynamics followed by the system are depicted in 
Figure 3 (for x < 0) and Figure 4 (for x > 0). We now prove that we could 
find infinitely many solutions to our problem. Indeed, consider an initial datum 
P in = {P11P2) sucn that Pi n +P2 n = an d Pi < < pf- Recalling Proposition^! 
and setting a° = a 1 = ^f-, we have 

„in 1 

g^a 1 )<-2<-l = ^<--<g + (a°), 
Pi 2 

i.e. p m belongs to the region between the stable orbit for the negative system 
(say 7g) and the unstable one for the positive system (say 7^), provided it's 
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\ \ 

Figure 4 



been chosen sufficiently near the origin. Therefore to any choice of p ln there 
corresponds an admissible solution tending respectively to either K 1 or K° as 
s — > ±00. 

Moreover, if the unstable orbit for the dynamics in Figure 3 (say 7^) intersects 
the stable one for the dynamics in Figure 4 (say 7g ), we can obtain an additional 
solution considering as initial datum that point of intersection. Indeed the 
function given by the juxtaposition of 7^ and 7J corresponds, in the original 
variable x, to a solution defined on a bounded interval with x_ < < 

2+ by the choice of the rescaling. This solution can then be extended to an 
admissible trajectory defined on the whole real line by using 7^ for x < X- and 
7^ for x > x+. 

Remark 2 The same construction can be applied when K° £ As and K 1 G A.7. 
4.2 Case 2 

Now we want to show, by means of a second example, how a simple change 
between the positive and negative behaviors of the costs, can lead to completely 
different result. Namely, we consider costs with a single jump in their deriva- 
tives, located in x — s(x) — 0, and K° € .A3, K 1 e A4. This choice produce a 
game with no admissible solutions to (|2.17l) . 

We proceed by contradiction. Assume that an admissible solution p = (pi,P2) 
exists, for a Cauchy problem with initial datum p(0) = p ln . Then, recalling the 
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results in [2], we have that 

lim \p(s)\ < +00 

s — >+oo 

actually implies 

lim |p(s)|=0, 

s — >+oo 

and hence p is one of the stable orbits of the positive system. Now we underline 
that this means p m 7^. Then, we can repeat the proof of Theorem |3 given 
in P|, and find 

lim \p(s)\ = +00 , 

for a suitable s < 0, eventually s a = —00. Therefore the solution cannot be 
admissible, and we have a contradiction. 

Notice that the previous calculations hold even if the unstable orbit for the 
dynamics in Figure 3 (say 7^) intersects the stable one for the dynamics in 
Figure 4 (say 7<t). This means there is no solution as the one built in the 
previous case, using more trajectories in the s variable: this is obviously due to 
the fact that we cannot find solutions bounded at +00 (resp. —00) to extend a 
possible p when x > x+ (resp. x < x_). 

Remark 3 The same result can be obtained when K° £ A7 and K 1 G As- 

Remark 4 Actually, one can still construct particular cases so that there exist 
admissible solutions. Fixed K° .K 1 as above, assume that the trajectories 7^ 
and 7g" intersect in a point. Moreover, set X- and x+ the values introduced in 
the previous example, £= \x+ — X-\ and J n =]x- +n£, x+ + n£[, n 6 Z. We can 
define piecewise linear costs on the whole K by repeating on each J n the same 
2-value piecewise linear cost. In other words, Vn G Z set 

h'(x)< - f K °i ifxe]x-+n£,ne[ , 
hiW \j n ~ \ k\ ifx£}n£,x+ + n£[ I 4 - 1 ) 

Then, we find a solution by simply gluing together periodically 7^ and 7^ . This 
solution is admissible, being bounded in the P\,P2 plane. 
Anyway no general results as Theorem^ is possible. 

5 Mixed Cases 

In this section we end our presentation of ill-posed problems, with a last example 
presenting costs that can switch from a situation with conflicting interests into 
a cooperative one. More precisely, we consider costs with a single jump in their 
derivative, located again in x = s(x) = 0, and K° G A5U Aq, K 1 £ A\ U A2- 
Moreover, let us assume 

a^/l-o". (5.1) 

1 1 
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Pi 




Pi 



Figure 5 



With these assumptions, the system follows the dynamics depicted in Figure 5 
(resp. Figure 2) for x < (resp. x > 0) and K° ,K X are not on the same line 
through the origin. 

Again, we observe the existence of infinitely many Nash equilibria. Assume 
it holds a° < a 1 in (|5.1I) (the opposite inequality leading to a similar analysis). 
Then, we can consider the non-empty region 



This region is, at least near the origin, say in a neighborhood O, exactly the 
region between the stable orbit for the positive system and the unstable one for 
the negative system. Taking as initial datum any point p ln both in CI and in O, 
we can construct an admissible solution in the following way. We take for s < 
the unique solution to the negative system, passing through p m at s = and 
tending to K° as s — *• — oo. In an analogous way, we take for s > the unique 
solution to the positive system, passing through p ln at s — and tending to 
K 1 as s -> +oo. Every such a solution, being continuous and bounded in s, 
corresponds to an admissible solution u(x). 
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